On the minimum description length principle for sources with piecewise constant parameters
نویسندگان
چکیده
منابع مشابه
On the minimum description length principle for sources with piecewise constant parameters
Universal lossless coding in the presence of finitely many abrupt changes in the statistics of the source, at unknown points, is investigated. The minimum description length (MDL) principle is derived for this setting. In particular, it is shown that for any uniquely decipherable code, for almost every combination of statistical parameter vectors governing each segment, and for almost every vec...
متن کاملMinimum Description Length Principle
The minimum description length (MDL) principle states that one should prefer the model that yields the shortest description of the data when the complexity of the model itself is also accounted for. MDL provides a versatile approach to statistical modeling. It is applicable to model selection and regularization. Modern versions of MDL lead to robust methods that are well suited for choosing an ...
متن کاملDenoising with flexible histogram models on Minimum Description length principle
Denoising has always been theoretically considered as removal of high frequency disturbances having Gaussian distribution. Here We relax this assumption and the method used here is completely different from traditional thresholding schemes. The data are converted to wavelet coefficients, a part of which represents the denoised signal and the remaining part the noise. The coefficients are distri...
متن کاملOptimization Framework with Minimum Description Length Principle for Probabilistic Programming
Application of the Minimum Description Length principle to optimization queries in probabilistic programming was investigated on the example of the C++ probabilistic programming library under development. It was shown that incorporation of this criterion is essential for optimization queries to behave similarly to more common queries performing sampling in accordance with posterior distribution...
متن کاملMolecular evolutionary phylogenetic trees based on minimum description length principle
Ever since the discovery of a molecular clock, many methods have been developed to reconstruct the molecular evolutionary phylogenetic trees. In this paper, we deal with this problem from the viewpoint of an inductive inference and apply Rissanen’s minimum description length principle to extract the minimum complexsty phylogenetic tree. OUT method describes the complexity of molecular phylogene...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 1993
ISSN: 0018-9448
DOI: 10.1109/18.265504